DETERMINISTIC POLYNOMIAL TIME ALGORITHMS FOR 
MATRIX COMPLETION PROBLEMS 
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Abstract. We present new deterministic algorithms for several cases of the maximum rank 
matrix completion problem (for short matrix completion), i.e. the problem of assigning values to the 
variables in a given symbolic matrix as to maximize the resulting matrix rank. Matrix completion 
belongs to the fundamental problems in computational complexity with numerous important algo- 
rithmic applications, among others, in computing dynamic transitive closures or multicast network 
codings IHKMOSl IHKY061 . We design efficient deterministic algorithms for common generalizations 
of the results of Lovasz and Geelen on this problem by allowing linear polynomials in the entries of 
the input matrix such that the submatrices corresponding to each variable have rank one. 

Our methods are algebraic and quite different from those of Lovasz and Geelen. We look at the 
problem of matrix completion in the more general setting of linear spaces of linear transformations, 
and finding a max-rank element there using a greedy method. Matrix algebras and Modules play a 
crucial role in the algorithm. We show (hardness) results for special instances of matrix completion 
naturally related to matrix algebras, namely: in contrast to computing isomorphism of modules (for 
which there is a known deterministic polynomial time algorithm), finding a surjective or an injective 
homomorphism between two given modules is as hard as the general matrix completion problem. 
The same hardness holds for finding a maximum dimension cyclic submodule (i.e. generated by a 
single element). For the "dual" task, i.e. finding minimal number of generators of a given module, 
we present a deterministic polynomial time algorithm. The proof methods developed in this paper 
apply to fairly general modules and could bo also of independent interest. 
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1. Introduction. A linear matrix is a matrix having linear polynomials as its 
entries, say the linear polynomials are over a field F and in F[a;i, . . . , a;„]. The problem 
of maximum rank matrix completion, or just matrix completion for short, is the prob- 
lem of assigning values from the field F to the variables xi, . . . ,Xn such that the rank 
of a given linear matrix is maximized (over all possible assignments). The notion of 
linear matrices appears in several places including both theory and applications, see 
|HKM05[ IHKY06| for several references. The problem of matrix completion is a well 
studied problem, dating back to the work of Edmonds [Edm67j and Lovasz [Lov79| . A 
similar problem (basically an equivalent one) is nonsingular matrix completion, where 
we have a square linear matrix and we are interested in an assignment resulting in a 
nonsingular matrix. If the ground field is sufficiently large then the maximum rank 
achieved by completion coincides with the rank of the linear matrix considered as a 
matrix over the function field F(a:i, . . . ,Xn), and hence, by standard linear algebra, 
finding a maximum rank completion (equivalently determining the maximum rank) 
is in deterministic polynomial time reducible to instances of finding (equivalently de- 
ciding the existence of) nonsingular completion of certain minors. Lovasz gave an 
efficient randomized algorithm to find a matrix completion using the Schwartz-Zippel 
lemma |Sch801 |Zip79| , deducing that a random assignment of the variables will max- 
imize the rank if the field is large enough (see also |IM83| ) . This is a method also 
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useful in the fundamental problem of polynomial identity testing (PIT). Indeed ma- 
trix completion is equivalent to a special case of PIT: any arithmetic formula can be 
written as the determinant of a linear matrix ' Val79] , hence the formula would be 
nonzero iff the corresponding matrix could attain full rank (assuming a large enough 
field). Over large fields, this makes matrix completion an important problem in ZPP, 
as its derandomization would imply circuit lower bounds (see Kabanets & Impagliazzo 
[KIO3;). 

Over small fields, matrix completion soon becomes a hard problem. This version 
has some important practical applications, for example in constructing multicast net- 
work codes [HKMOS J. and hence there are several results in the literature specifying 
the exact parameters for which the problem becomes NP-hard. The hardness of ma- 
trix completion and various related problems were first studied by Buss et al. |BFS99| 
and more recently by Harvey et al. [H KY06J . In the former paper nonsingular ma- 
trix completion is proved to be NP-hard over fields of constant size, while the latter 
showed that matrix completion over the field F2 is NP-hard even if we restrict to a 
matrix where each variable occurs at most twice in its entries. This naturally raises 
the question: can we solve matrix completion by restricting the way the variables 
appear in the input matrix? 

Few such cases are already known and they all look at mixed matrices^ i.e. linear 
matrices where each entry is either a variable or a constant. Harvey et al. [HKM05] . 
building on the works of Geelen |Gee99j and Murota |MurOO| . gave an efficient de- 
terministic algorithm for matrix completion over any field if the mixed matrix has 
each variable appearing at most once. While Geelen at al. |GIM03[ IGI05| gave an 
efficient deterministic algorithm when the mixed matrix is skew- symmetric and has 
each variable appearing at most twice. 

Completion by rank one matrices: In this paper we are interested in cases 
that are more general than the first case [HKM05] . Consider a linear matrix A G 
¥[xi, . . . , a;„]™^™ where the submatrix "induced" by each variable is of rank one, i.e. 

Bo + xiBi + -- ■ + XnBn where Bi, . . . , Bn are constant matrices of rank one (note 
that Bq is also a constant matrix but of arbitrary rank). The case Bq = was first 
considered by Lovasz in [Lov89| . where it is shown how Edmonds' matroid intersection 
algorithm can be applied to solve this special case in deterministic polynomial time. 
The first main result in this paper is a common generalization of the results of Lovasz 
[Lov89| and Geelen |Gee99j : we show that matrix completion problem for an arbitrary 
Bq can be solved in deterministic polynomial time over any field: 

Theorem 1.1. Let ¥ be a field and let Bq, . . . , _B„ be m x m matrices over ¥. If 
Bi, . . . , Bn are of rank one then matrix completion for the matrix {Bq + xiBi + ■ ■ ■ + 
XnBn) can be done deterministically in poly{m, n) field operations. 

The proof of this theorem basically involves looking at the linear space L := 
(-Bo, Bi, . . . , Bn) of matrices and showing that a greedy approach can be utilized to 
gradually increase the rank of an element in L. Our methods are more algebraic and 
quite different from those of Lovasz and Geelen. In particular our method is robust 
enough to check whether a given matrix in L has the largest possible rank without 
needing the rank one generators of L, they are needed only if we want to increase the 
rank (see Section [21). 

Matrix algebras or algebras of linear transformations (in this paper by an algebra 
we mean a linear space of matrices or linear transformations that is also closed under 
multiplication) play a crucial role in the algorithm for Theorem ll.il We consider spe- 
cial instances of matrix completion problems where algebras of linear transformations 
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arise naturally. These are certain module problems. 

Preliminaries about modules: If U and V are vector spaces over the field 
F then we denote the vector space of linear maps from f7 to F by Lm{U,V). For 
Lin(C/, U) we use the notation Lin(C/). For simplicity, in this paper we consider mod- 
ules over finite sets. (Actually, we work with modules over free associative algebras, 
however the main concepts and computational tasks we are concerned with can be 
understood without any knowledge from the theory of abstract associative algebras.) 
Let iS be a finite set. A vector space V over the field F equipped with a map v from 
iS into Lin(y) is called an ¥{S}-module (or an tS-module for short if F is clear from 
the context). We assume that the data for an 5-module is input by an |iS|-tuple of 
dim V by dim V matrices. In cases when the map v is clear from the context - most 
typically when S is itself a set of linear transformations - we omit v and denote the 
result v{B)v of the action of i? G 5 on i; G ^ by Bv. For a set S' C Lin(T^) of lin- 
ear transformations the enveloping algebra Env(iS') is the smallest algebra containing 
<S'. It is the linear span of finite products of transformations from S' (and maybe 
noncommutative) . 

In the context of 5-modules the algebra A — Env(z^(iS) U /) is of special interest 
(/ is the identity in Lin(y)). An S-suhmodule of y is a linear subspace closed under 
the action of all the transformations in j^(5). Obviously, the intersection of a family 
of submodules is again a submodule. In particular, if T is a subset of V then there is a 
smallest submodule of V containing T: the submodule generated by T. It is AT, the 
linear span of vectors obtained by application of transformations from A to vectors 
from T. The set T C 1/ is a system of generators for the tS-module V ilV — AT. 

Cyclic submodules, i.e. those generated by a single element, are of particular 
interest. For v £ V we consider the map : A ^ V given by Hv{B) = Bv. 
Obviously, fx^ is a linear map from A into V and the set € V} is a linear space 

of linear maps from A to V . The rank of fiy is the dimension of the submodule Av 
generated by v. 

A "Universal" Module Problem: The matrix completion problem in this 
context is finding an element v which generates a submodule of maximum dimen- 
sion. It turns out that this problem, which we call cyclic submodule optimization, is 
universal in matrix completion: there is a deterministic polynomial time reduction 
from maximum rank matrix completion to cyclic submodule optimization (over an 
arbitrary base field) . We show this universality in Section [3l Universality implies 
two hardness results. First, existence of a deterministic polynomial time algorithm 
for cyclic submodule optimization would imply deterministic solvability of the matrix 
completion problem over sufficiently large fields. Also, over small fields, cyclic sub- 
module optimization is iVP-hard. Second, we get analogous hardness results for the 
existence of injective resp. surjective homomorphisms between modules (a iS-module 
homomorphism from V to V' is a linear map in Lin(y, V) that commutes with the 
action of S) : 

Theorem 1.2. There is a deterministic polynomial time reduction from the 
existence of (resp. finding) a nonsingular matrix completion to the problem of checking 
for the existence of (resp. finding) a surjective (or injective) homomorphism between 
two modules. 

This result is remarkable in view of the recent deterministic polynomial time 
algorithm of Brookbanks & Luks |BL08| for module isomorphism problem (see also 
Chistov et al. |CIK97| over special base fields). 

A "Dual" Problem: In Section|3]we consider a problem which is in some sense 
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"dual" to the cyclic submodule optimization. This is finding a system of generators 
of smallest size for a module. In contrast to hardness of the former problem, we have 
an efficient solution to the latter: 

Theorem 1.3. Given a module structure on the n- dimensional vector space V 
over the field F in terms of m n x n matrices S, one can find the minimum number 
of generators of V deterministically using poly{m, n) field operations. 

Note that the above result includes testing cyclicity of modules efficiently over 
any field. This problem was considered in [CIK97j over special fields as a tool for 
constructing isomorphisms between modules. The algorithm is based on a greedy ap- 
proach analogous to the method for Theorem ll.il implicitly using certain submodule 
dimension optimization technique for a special class of (so called semisimple) modules. 

2. Matrix Completion with Rank One Matrices. Let V he & finite dimen- 
sional vector space over the field F and L < Lm{V) be a F-linear space of linear 
transformations. Recall that Env(L), the enveloping algebra of L is the linear span 
of products hih2 ■ ■ ■ hg {s > 1, hi, . . . ,hs G L). Obviously, Env(L) is also spanned 
by products of elements from an arbitrary basis of L. We will use the action of the 
enveloping algebra on the kernel of an idempotent transformation to optimize rank 
in a linear space, to that effect we present the following lemma. Its proof will also 
suggest how to greedily increment the rank. 

Lemma 2.1. Let V be a finite dimensional vector space over the field ¥, let 
L < hm{V) and assume that e € L is an idempotent (e^ = ej such that rk e > rk /i 
for every h ^ L. If L is spanned by e and certain rank one transformations, then 
Env(L) kere C eV . 

Proof. Assume, for contradiction, that Env(L) ker e is not contained in eV . Then 
there exists a vector v G kere such that L'^v % eV for some integer s. Let s > 1 
be the smallest among such integers. Then there are matrices hi, . . . ,hs G L with 
hs ■ ■ ■ h2hiv ^ eV such that for every i, the matrix hi is either e or has rank one. 
Assume that hj = e for some j < s. Then j > 1 as et; = 0. Furthermore, the 
minimality of s implies 

hj^i---hiv GeV, (2.1) 

therefore, as ew = w for every w € eV, we have hg • ■ • hj+ihjhj-i ■ ■ ■ hiv = kg - • ■ 
hj^iehj-i ■ ■ ■ hiv — hs • ■ ■ hj^ihj^i ■ ■ ■ hiv, contradicting the minimality of s. Thus 
all the matrices hi, . . . ,hs are of rank one. Set vq — v and for \ < i < s, vi — hiVi^i. 
The minimality of s implies that for every 1 < « < s we have Vi G \ X]j=o ^'''>^- 
In particular, the vectors vq, ■ . ■ ,Vs are linearly independent. Since hi is a rank one 
transformation on V, 

h,V = Fu,, for aU 1 < i < s. (2.2) 

From this, and from the minimality of s we infer hjVi^i — for every I < i < j < s 
(otherwise Vj G hjU^^v C Uv). We show below that a :^ e + hi + . . . + hg is of a 
rank higher than e, leading to the desired contradiction. 

Informally, we build a basis in which the matrix of a is upper triangular. First 
we see that (keep in mind Equations 12.11 fc 12. 2p avi-i = evi-i + X]j<i hjVi^i + u,; + 
J^jyi hjVi^i =Vi + evi-i + J2j<i hjVi-i GVi + evi-i + Y.j<i ^""j ^Vi + {vi, . . . , Vi-i) 
{i — 1, . . . , s). (With some abuse of notation, for i = 1, by (wi, . . . , Vi-i) we mean the 
zero subspace.) Hence the vectors av^, . . . , avs-i span the subspace {vi, . . . , Vg). Let 
W he a, direct complement to the subspace {vi, . . . , Vs^i) in eV and wi, . . . ,Wt be a 
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basis of W (i = rk e — s + 1). Then aWi — eWi + J2j=i hjWi — Wf + hjWi € 

Wi + (''^ij ■ ■ ■ T^s) (by Equation 12. 2p . Therefore the vectors awi, . . . , awt are Unearly 
independent even modulo the subspace Together with the fact that 

{avQ, . . . ,avs-i) = {vi,...,Vs), this iniphes that {avo, . . . ,avs^i,awi, . . . ,awt) = 
{vi, . . . ,Vs,wi^ . . . ,wt) — {eV, Vg). Thus the image of a contains a subspace of di- 
mension rk e + 1 and hence rk a > rk e + 1 , as claimed. □ 

In the proof above, the special case s = 1 deserves special attention. In that case 
we have a simple method for increasing the rank over sufficiently large fields which 
works even without any assumption on the presence of rank one matrices. We will use 
this simple observation later in Section |4l 

Lemma 2.2. If h,h" e Lm(U,V) are transformations such that h"kcrh ^ hU 
then h' := h + ah" will be of a higher rank than h except for at most rk 1 elements 
ae¥. 

Proof. Let k ~ rk h, and let Uq be a subspace of U complementary to ker h. Let 
ui, . . . be a basis of Uq and let ui, . . . ,Vk be a basis of the image hU. Choose 
a vector u^+i G ker/i such that Vk+i := h"uk+i ^ hU. Consider the matrix of the 
restriction of h + xh" to Uq + ¥uk+i in the bases ui, . . . ,Uk,Uk+i and wi, . . . ,Vk,Vk+i- 
The last row of the constant term (the matrix of h) is zero while the lower right entry 
of the linear term (the matrix of xh") is x. Expanding by the last row, we obtain 
that the linear term of the determinant of this (fc + 1) by (fc + 1) matrix is dx, where 
d 7^ is the determinant of the upper left k x k block of h. Thus the determinant 
is a nonzero polynomial in x of degree at most (fc + 1) and hence the corresponding 
(fc-l- 1) by (fc + 1) block of h' = h + ah" is nonsingular showing that h' has rank higher 
than k unless a is a root of this polynomial. □ 

We state below a simple fact about the linear spaces of matrices that is useful in 
providing a certificate for the rank maximality of a given matrix. 

Fact 2.3. Let L < hm{U,V), where U and V are finite dimensional spaces over 
the fieldW. Then for every h ^ L we have rk /i < dim U ~max{Ami W^— dim LW \ W < 
U}. 

Proof. For any subspace W < U pick a direct complement W of W in U. 
Now dimC/ - rk /i = dimC/ - dimhU > {dimW - dimhW) + (dim W - dim hW) 
> dim W - dim LW. □ 

Using Edmonds' Matroid Intersection Theorem, Lovasz (Section 3, |Lov89j ) has 
shown that equality holds provided that h is of maximum rank and if L is spanned by 
rank one matrices. We give the following algorithmic generalization to the case when 
L is spanned by rank one matrices and an arbitrary rank matrix. 

Theorem 2.4. Let U and V be two finite dimensional vector spaces over the field 
¥, let L < Lin(?7, V) be given by a basis and let an h G L be also given. Suppose that 
L is spanned by h and certain (unknown) transformations of rank one. 

1 ) Then there exists a deterministic polynomial time algorithm which decides if h 
is an element of L of maximum rank. If h is of maximum rank then a subspace W of 
U is constructed such that rk ft, = dim [/ — (dimT4^ — dim. LW). 

2) If h is not of maximum rank then, given rank one transformations that together 
with h span L, we can compute an element h' d L with rk ft' > rk /i in deterministic 
polynomial time. 

Proof. We may assume wlog that dimU — dimV, for otherwise we can pad 
transformations from L with zeros to obtain a space L' < Lin(C/© U', V S) V), where 
dimU ®U' ^ dimy V' with some (possibly zero) spaces U' ,V' . By padding a 
transformation b G Lin(J7, V) we mean the map 6' G Lin([/ ®U' ,V ® V) which is the 
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direct sum of b and the zero map: b'{u,u') = {bu,0). 

Let g : y — > J7 be an arbitrary nonsingular linear map such that gh : U U is 
an idempotent. (The matrix of such a map g can be obtained as the product of the 
matrices corresponding to the pivoting steps in Gaussian ehmination for the matrix 
of h.) As g is invertible, h is of maximum rank within L iff gh is of maximum rank 
within gL. Also, rank one generators of L are mapped to rank one generators of gL. 
If gh is of maximum rank then by Lemma 12. li Env((7L) ker 17/1 < ghU. Conversely 
if 'Env{gL)kcT gh < ghU then, with Wq := Env{gL)ker gh and Wi :— ker gh, we 
have gLWo,gLWi < Wo < ghU, and Wo n Wi^O (if v £ WqCiWi then v = ghu 
for some u G U and ghv = 0, implying = ghghu — ghu — v). Therefore with 
W := Wo + Wi < U we have gLW < Wq and dim U — rk gh = ker gh = dim Wi = 
dimW — dim Wo < dimW — dim^LW. Now g being invertible also implies that 
dim U — ik h < dim W — dim LW, which together with Fact 12.31 implies that h has 
maximal rank. Thus if Env{gL) ker gh < ghU then we can efficiently construct W 
with the required property, it is a witness of the maximality of the rank of gh (resp. 
h) in gL (resp. L). Thus, h and hence gh is not of maximum rank if and only if 
Env(gL) kev gh is not contained in ghU . This can be decided in an obvious way. 

Furthermore, if L is spanned by h and (known) rank one matrices hi, . . . ,hi then 
the proof of Lemma 1 2. II gives a linear combination of gh and ghi, . . . , ghi of higher 
rank. Multiplying by g~^ we obtain an element of L of rank larger than rk h. □ 

It is obvious that repeated applications of Theorem 12.41 completes the proof of 
Theorem O 

We remark that the shortest product 11 = ghi ■ ■ ■ ghi with 11 ker h % hU in the 
proof of Lemma l2.1l can be interpreted as a generalization of the notion of augmenting 
paths in the classical bipartite matching algorithms. 

3. Module Morphism Problems and Matrix Completion. In this sec- 
tion we present hardness results of certain problems concerning modules. The key 
constructions are modules that we call bipartite modules as they resemble bipartite 
graphs. 

3.1. Bipartite modules. Let Wi and W2 be two linear spaces over F and as- 
sume that we are given a linear subspace R < Lin(Wi, W2) of linear maps from Wi 
to W2. We assume that R is spanned by £ maps: ri,. . . ,rg. We consider the direct 
sum W = Wi © W2. We extend transformations r G R to linear transformations of 
W by letting r act on W2 as the zero map. (That is, the extension maps {wi,W2) 
to (0,™!).) With some abuse of notation, we denote the extended map also by r 
and consider i? as a subspace of Lin(W). Let S be the set {ri, . . . , rg} and the map 
1^ : S Lin(W) defining the iS-module structure be just the identity map. This 
iS-niodule W is a bipartite module. 

3.2. Universality of cyclic submodule optimization. Assume that we are 
given a linear space L of F-linear maps from U to V. It would be straightforward to 
consider the bipartite module W for Wi — U, W2 = V and R = L. However, this 
module does not turn out to be useful for our purposes and instead of it we consider 
another view: put Wi — L, W2 = V, R = G C/}, where ^„(/i) — h ■ u. Then, if 
U is spanned by ui, . . . , then S is {^m , ■ • ■ , fJ-ue}- Let {h, v) £ W ~ L (B V . Then 
the iS-submodule of W generated by {h, v) is ¥{h, v) + (0, hU) and its dimension is 
(1 + rk /i) if ft, is not the zero map. Therefore this construction transforms matrix 
completion in L to cyclic submodule optimization in W. 
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3.3. Module morphisms. Let U and V be two F{ 5} -modules. An F-linear 
map (/i G Lin([/, V) is an iS-module homomorphism if for every s G 5 and u d U we 
have (j){su) = s(f>{u). The module homomorphism from ?7 to 1^ form a linear subspace 
Hom][r{^5}(C/, y) of Lm{U,V). Given the tS-module structure on U and V in terms 
of matrices over bases, a basis for the matrix space representing Hom]f{5j(C/, V) can 
be computed with poly{dimU + dimT^ + li^l) field operations by solving a system of 
homogeneous linear equations. 

It is not difficult to construct subspaces of Lm{U, V) which do not arise as spaces 
of module homomorphisms. Thus it is natural to ask how difficult are the matrix com- 
pletion problems in spaces of module morphisms. It turns out (as shown below) that 
the cyclic submodules of a bipartite module W (defined as L®V in the last subsection) 
arise as homomorphic images of another 5-module Wq, where S ~ {ri, . . . , rg} and 
Wq has basis bQ,bi, . . . ,bi that by definition satisfy r^foo ^ bi, ribj =0 {i, j = !,...,£). 

This shows that hard matrix completion problems do arise in module morphism 
spaces. However, curiously enough, deciding existence and construction of module 
isomorphisms, i.e., module homomorphisms which are bijective linear maps can be 
accomplished in polynomial time (see |CIK97j with some restriction for the base field 
and |BL08j over arbitrary fields) . We show that this is not the case for testing existence 
of injective or surjective module morphisms. 

Module Injection: For the injective case, consider the bipartite modules W 
and Wq discussed above. The module Wq is cyclic, it is generated by bo- Therefore 
a module homomorphism is determined by the image of bo- In this case for every 
pair (wi,W2) there is indeed a homomorphism with V'(^o) — (^1,^2). (For i > 
set ijj{bi) = (0, rjWi).) Consider the special case of the bipartite module W used for 
showing hardness of cyclic submodule optimization: let L be a space of linear maps 
from U to V, put Wi — L and W2 = V. Then the image of Wq at the map ip, under 
which the image of 60 is {h, v), is the subspace spanned by {h, v), (0, hui), . . . , (0, hue). 
This i/j is injective if and only if h is. This construction reduces both deciding and 
finding an injective transformation in L (and also nonsingular matrix completion as 
special case) to deciding and finding an injective homomorphism from Wo to W. 

Module Surjection: Existence of (resp. finding) injective module morphisms 
can be transformed to the existence of (resp. finding) surjective morphisms between 
modules by standard dualization. If M is a vector space over F then by M* we denote 
the space of (homogeneous) linear functions from M to F (that is, M* — Lin(M, F)). 
If is an F-linear map from the space Mi to M2 then the map (jf : given as 

{(j)* f )v — 4>{fv) is again a linear map. (Note that if 4> is interpreted as multiplication of 
column vectors by a matrix from the left then (jf can be interpreted as multiplication 
of row vectors by the transposed matrix from the right.) Furthermore, if both Mi 
and M2 are finite dimensional then is injective (resp. surjective) if and only if (p* is 
surjective (resp. injective). If Mi and M2 are 5-modules given by the maps vi and V2, 
then vl and V2 given as v*{s) = Vi{s)* make and iS-modules. Furthermore, 
the linear map 4> G Lin(Mi,M2) is a module homomorphism from Mi to M2 if and 
only if (p* is a module homomorphism from Mj to Mi . 

So when given vector spaces [/, V over F, a linear subspace L of Lin(C/, V) with 
t := dimC/. We first construct modules W and Wq as in the previous reduction, so 
that the module homomorphism "0 from Wq to W is injective if and only if /i G L is 
an injective map where -0(^0) — {h, v). Therefore G }iomf^sy{W* , Wq ) is surjective 
if and only if for the unique F-linear map tp : Wq — > W such that 'i' = tp* we have 
that h is injective, where V'(&o) = {It-jV). This completes the proof of Theorem ll.2l 
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4. Minimizing Number of Generators in Modules. We saw that cyclic 
submodule optimization is matrix completion hard. Now we will study the "dual" 
problem of finding minimal number of generators of a given module. In this section 
we give an efficient algorithm to minimize the number of generators in a given F{iS}- 
module. It depends on a greedy property of the dimension of submodules in so called 
semisimple modules (which will be vaguely similar to that in Section [2]). But we first 
need to summarize some basic notions and facts from the representation theory of 
algebras needed in the proof. For details, we refer the reader to the first few chapters 
of the textbook [Pie82| . 

4.1. Preliminaries: Algebras, Modules &: their Decompositions. Let F 

be an arbitrary field. An associative algebra with identity or algebra for short is a 
vector space A over F equipped with an associative F-bilinear multiplication having 
a two-sided identity element 1_4 with respect to the multiplicative structure. If V is 
a finite dimensional vector space of F then the F-linear transformations of V form a 
finite dimensional algebra Lin(l/). Subalgebras of Lin(F), that is, subspaces closed 
under multiplication, containing the identity matrix are further examples. (In contrast 
to Section [21 where we considered algebras of linear transformations not necessarily 
having an identity, in this Appendix it will be convenient to consider algebras with 
identity only.) An algebra homomorphism from ^ to 6 is an F-linear map (j) : A ^ B 
also satisfying 4>{ai ■ 02) = 0(ai) • <t>{a2) and 4>(1a) = ^B- 

A left ^-module or an A-module for short is an F-linear space V equipped with a 
bilinear multiplication ■ : Ay~V ^ V which commutes with the multiplication within 
A (that is, oi • (02 • v) = (ai ■ 02) • v)). (In Pic82j , right modules are used. Here we 
we use left modules which are somewhat more common in the literature.) A module 
V is unital if Ij^v = v for every v G V. All modules in this work are assumed to be 
unital and finite dimensional over F. 

If V is an .A-module then the map v : A ^ Lin(V^) defined as v{a)v = a ■ v is 
a homomorphism from A into Lin(y). We say that ^ is a faithful A-module if the 
kernel of v is zero, that is, if a 6 A such that av = Q for every v then a = 0. If 
iS is a finite set then F{iS}, the algebra of noncommutative polynomials over F with 
indeterminates from S is an example of an infinite dimensional F-algebra. It is the free 
algebra generated by 5: if A is an algebra and is a map from S into A then v can 
be extended to a unique algebra homomorphism from F{5} to A. In view of this, an 
F{iS}-module structure on V can be given by an arbitrary map v : S ^ Lin(V^). Thus 
the notion of 5-module used in this paper is consistent with the notion of modules 
over free algebras. 

A submodule of an A-module is a linear subspace also closed under multiplication 
by elements of A. The factor space of a submodule inherits the A-module structure 
in a natural way and so do direct sums of linear spaces which are A-modules. An A- 
module V is called simple if it has exactly two submodules: the whole V and the zero 
submodule. The radical of a module is the intersection of its maximal (more precisely, 
maximal proper) submodules. A module V is called semisimple if it is isomorphic to 
a direct sum of simple modules. By Section 2.7 of [ Pie82| . V is semisimple if and 
only if its radical is the zero submodule. Furthermore, the factor module of V by its 
radical is always semisimple. By Section 2.5 of |Pie82| . the isomorphism classes of the 
constituents and their multiplicities in a decomposition of a semisimple module into a 
direct sum of simple modules are uniquely determined. Direct sums and homomorphic 
images of semisimple modules are semisimple. 

Let F be a finite dimensional F{tS}-module and let A be the enveloping algebra 
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Env(/Ui/(iS)) (the subalgebra of Lin(F) generated by the identity and i^{S)). Then A 
is the image of F{iS} under the unique algebra homomorphism from F{iS} to Lin(y) 
extending v and ^ is a faithful .4-module in the natural way. We work with the A- 
module structures of V, its submodules and factors as they coincide with the iS-module 
structures of the same objects. Assume that V is semisimple. Then by Section 4.1 
of [Pie82| , A considered as a left module over itself by the algebra multiplication is also 
semisimple. Such algebras are called semisimple. Modules over semisimple algebras 
are semisimple, again by Section 4.1 of |Pie82] . 

Let ^ be a semisimple algebra over F and let ^ as a left module over itself be 
isomorphic to the direct sum: 

0^r% (4.1) 

1=1 

where Vi are pairwise non-isomorphic .A-modules. Let V be an ^-module. As is a 
homomorphic image of at most dim V copies of the module A, we have 

t 

V<^^V;% (4.2) 

where the multiplicities Si are non-negative integers. 

Lemma 4.1. Let A and V be as above and let £ be a positive integer. Let U be a 
submodule ofV generated by £ elements. Then U is of maximum dimension among the 
l-generated submodules ofV if and only if U ^ ®i=i ^^f' where di := mui(si,£mi). 

Proof. Let Wi be the sum of all simple submodules of V not isomorphic to Vi, 
Then the ^-module V/Wi is isomorphic to V^/' and that the submodule dimension 
in V is maximized iff it is maximized in V/Wi for all i G [i]. As a single generator 
in V^^ can generate a submodule of dimension at most that of ]/^™'"('*»'™»)^ gg^ 
that £ generators in V^^ can generate a submodule of dimension at most that of V^^ . 
Repeating this for every i G {1, . . . ,t}, we obtain that the maximum dimension is at 
most the dimension of the direct sum in the statement. 

To see that this module occurs in fact as a cyclic submodule of V, let W be 
the direct sum of £ copies of A (as a left ^-module) and let wi — (1^, 0, . . . , 0), 
. . . , Wi = (0, . . . , 0, 1^). Let Wo be a submodule of W isomorphic to ©*^;^ y^im.-di 
and let Vb be a submodule of V isomorphic to 0*^i Vf'. Then Vq = W/Wq and 
W/Wq is generated by £ elements: the images of wi,...,we under the projection 
W W/Wq. Thus Vq can be generated by the images of the latter £ elements under 
any isomorphism W/Wq = Vq. D 

4.2. A Greedy Optimization of the Submodule Dimension in Semisim- 
ple Modules. In this section V denotes a finite dimensional F{iS}-module and A 
stands for the enveloping algebra Env(i/(iS) U /). For subsets B C A and U C V 
by BU we denote the linear span of the products bu, where b G B and u £ U . In 
this context we omit braces around one-element sets. In particular, for v £ V, the 
submodule generated by v is Av. 

The annihilator Ann^(C/) oi U C V is {a £ A\au = for every u £ U}. Note 
that the annihilator Ann^(u) of the single element v £ V is just the kernel of the 
linear map fiy : A ^ V given as /it, (a) — av. The following lemma states that if the 
rank of /i„ is not maximal then we are in the situation of Lcmma l2.2l 

Lemma 4.2. Assume that V is semisimple. Then, for an arbitrary u £ V, 
dim^ii = niax{dim^w'|w' £ V} iff Armji{u)V C Au. 
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Furthermore, if Km\j\^(u)V % Au then an element u' with dim^w' > divciAu can 
he constructed using poly {\S\ + dimy) operations in F. 

Remark 4.3. The lemma generalizes a result of Bahai and Ronyai which was 
used in IB R90 1 for solving the cyclic suhmodule optimization in modules over simple 
algebras. The proof can he found in \CIK97I . For completeness, we discuss it here as 
well. The second part of the lemma is especially interesting for small hase fields where 
Lemma \2.^ does not apply. 

Proof. Let be a semisimple 5- module and let A = Env(/ U I'iS)). Let A 
resp. V be decomposed as in (|4.ip resp. (14. 2p . Let u € V. Assume that the dimension 
of the submodule Au is not maximal. Then, by Lemma 14. li there exists an index 
i such that the multiplicity of Vi in Au is less than both Si and to,;. Let W be the 
submodule of V which is the direct sum of the constituents of V not isomorphic 
to Vi. Then V/W = V"/' and V/{W + Au) is isomorphic V/^ with some h > 0. 
Recall that for a subset X of V the annihilator of X in A, denoted by Ann^(X) is 
{a A\ax — for every x d X}. Assume that Amij\^(u)V C Au. Then every element 
of Ann^(u) act as zero on the factor module V/Au and hence also on the factor 
V/{W + Au). As the latter module is isomorphic to V/^ we obtain that Ann_4(u) C 
Ann^(Vi). Recall that the map /i„ : — > y is given as ^«(a) = au. It is an ^-module 
homomorphism from the left module A to V . Its kernel is Ann^(u) and its image is 
Au. Therefore Au = A/ Ann_4^{u). Now Ann^(Vi) is also an y^-submodulc of A. Let 
i be a submodule of A isomorphic to Vi. We claim that LVi ^ 0. Indeed, if LVi = 
then, by the assumed isomorphism, LL = as well, which is impossible by Section 
3.2 of [Pie82| . The claim implies that the multiplicity of Vi in Annj,{Vi) is zero and 
the same holds in Ann^(M) C Ann_^(Vi). But then the multiplicity of Vi in the factor 
module ■4/Ann_4(u) = Au is to^. This contradiction finishes the proof of: if Au is not 
of maximum dimension then in fact Aimj{(u)V % Au. 

To see the reverse implication, assume that Ann^(M)y % Au and let w e V" and 
h G Annyi(M) such that hw ^ Au. By Section 2.4 of [Pie82j . there exists a submodule 
W of V such that W n = and W + Au = V. Write w ^ au + w' where a e A 
and w' G W. Put u' = u + w' . As Aw' £ W, we have Au' + W' ^ Au + W. On the 
other hand, from bw ^ Au but bau G Au we infer that bw' is a nonzero element of 
W' and by the equality bu' — bu + bw' ~ bw', it is also an element of Au' . Therefore 
dim^u' > dimy — dimVF' = dim^u, as required. 

For a polynomial time implementation of the construction above, notice that a 
basis for Ann_4(u) can be found by solving a system of linear equations. Then b 
and w can be found by testing membership of products of pairs of basis elements for 
Ann^(M) and those for V. To compute a direct complement of Au, we first compute 
a projection tt of y onto Au such that na = an for every element a € A (equivalently, 
for every element of a system of generators for A, say I'iS)). (Recall that a projection 
TT onto a subspace V' of ^ is a map whose image is V and it acts as the identity on 
V . If W is submodule complementary to Au then the unique linear map which is 
the identity on Au and zero on W is a projection onto Au which commutes with the 
action of ^ on V.) Once tt is constructed we take tt' = I — tt. It is straightforward to 
see that the image W = tt'V is in fact a direct complement of Au. The element w' 
in the argument above is then just n'w and u' = u + tt'w. This finishes the proof of 
Lemma l4T2l □ 

The next lemma can be used to give a generalization for submodules generated 
by larger systems (eg. noncyclic modules). 

Lemma 4.4. Assume that V is semisimple. Then, for arbitrary positive integer £ 
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and for elements Ui, . . . ,U£ €z V , dim^{7ii, . . . , ui} — max{dim^[/|t/ C V, j^lj < £} 
if and only if for every i £ [£], the S-submodule generated by + Wi in the factor 
module V/Wi is of maximum dimension, where Wi denotes the submodule generated 
by ui, . . . ...,Ui. 

Proof. Let F be a semisimple 5-module and let A = Env(/ U i^{S)). Let A 
resp. V be decomposed as in (|4.ip resp. (|4.2p . Let ui,...,U£ G V and let Wi = 
^({ui, . . . , Mf} \ {ui}). As A{ui, . . . , ue} — Aui + Wi, it is obvious that if, for some 
index i there is an element such that modulo Wi, Au[ has a larger dimension than 
Aui, then replacing Ui with u[ results in a system generating a submodule of larger 
dimension. 

To see the reverse implication let W = A{ui, . . . , u^} and assume that for every i, 
the submodule of V/Wi generated by Ui + Wi, that is, W/Wi is a maximal dimensional 
cyclic submodule of V/Wi. Let j G {l,...,t}. By Lemma HTTl for every i, the 
multiplicity of Vj in W/Wi equals either the multiplicity of Vj in V/Wi or it is just 
ruj . If for some index i the former is the case then the multiplicity of Vj in V/W is zero. 
Otherwise the multiplicity of Vj in W/Wi is rrij for every index i. In the former case 
the multiplicity of Vj in W is the maximum possible among all submodules. Assume 
the latter case and let Uij denote the direct sum of the constituents of Aui isomorphic 
to Vj. Then, for every index i, we have Uij n Wi = and Uij is isomorphic to a direct 
sum of nij copies of Vj as otherwise the multiplicity of Vj in W/Wi would be less than 
rUj . Thus Uij intersects J2i'^i ^i'j trivially therefore they form an independent system 

and hence X]i=i ^ij — Vj^^ showing that the multiplicity of Vj is optimal in this case 
as well. Repeating this for every irreducible module Vj, we obtain that the dimension 
of W is indeed the maximum possible. This finishes the proof of Lemma WM □ 

The two lemmas above together with Lemma immediately give the following. 

Proposition 4.5. Let vi,...,Vn be a basis of the semisimple ¥{S}-module 
V . Assume that ui, . . . ,ui are elements of V such that the submodule generated by 
ui, . . . ,Ui is not of maximum dimension among the submodules of V generated by at 
most £ elements. If the ¥{S}-module structure on V is given by an array of matrices, 
then we can find an index i and construct u'idV using poly{\S\ + n) operations such 
that replacing Ui with u[ results in a submodule of larger dimension. 

Furthermore, if |F| > n then there exist indices i ^ j & [n] such that replacing 
Ui with {ui + LUVj) results in a submodule of larger dimension except for at most n 
elements lo from F. 

The above greedy property for the submodules of a semisimple module gives us 
the following technical lemma for general modules. It will be useful in the subsequent 
algorithm for optimizing the number of generators in any module without computing 
the radical explicitly. 

Lemma 4.6. Let v\, . . . , w„ be a basis of the S-module V which can be generated 
by £ elements and let ui, . . . ,ui be elements of V such that U = A{ui, . . . , Ui} < V. 
If W is a nonzero submodule such that V — U (B W then there exist i d [£], j lE [n] 
such that for U' := A{ui, . . . ,Ui + Xvj, . . . , ue} , V = U' + W butU'nW ^ {0} except 
for at most 2n elements A 6 F. 

Proof Let Uq, Wq be the radicals of U, W respectively. Let Vq — Uo (B Wq. Then 
the factor module V/Vq = U /Uo®W/Wq is semisimple and we can apply the preceding 
Proposition 14.51 to choose i G G [n] such that the number of A's, for which the 
dimension of ([/' + Vb)/Vb is not larger than the dimension of {U + Vq)/Vo, is at most 
diml//Vb. Also for the same i,j the A's, for which {ui, . . . ,Ui + Xvj, . . . , ue} U W 
do not span the whole of V, are the roots of a nonzero F-polynomial of degree at 
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most dimy. Thus for this i,j the number A's, for which either dimC/' < dimt/ or 
V ^ U' + W, is at most dim V/Vq + dim V < 2n. Q 

4.3. Algorithm for Finding £ Generators. Using the previous Lemma, now 
we describe an iterative algorithm to find a minimal set of generators of a given module 
over a sufficiently large ground field. 

Input: An ^-module V given in terms of a set of generators. We assume that A is 
an F-algebra where |F| > 2d\mV. 

Output: A set of at most £ elements generating V over A. 
Algorithm: 

0) Initially pick any irredundant generating set {ui, . . . ,Ui, u^+i, . . .}, set U := 
A{ui, ...,ui} and W := A{ue+i, . . .}. Then V = U + W. 

Outer loop: 

1) Set W ■.= ur] w. 

2) liW' = W then output U and exit. 
Inner loop: 

3) apply Lemma l4!6l in V/W to obtain U' generated by £ elements and satisfying: 

U' + W and {U' + W')nW > W. 

4) If such a U' cannot be found then report "-^ generators are insufficient for y 
and exit. 

Else set [/ [/'. 

5) liW i^U + W' then continue inner loop with W = {U + W) n W. 
Else continue outer loop with W = W . 

Analysis of the algorithm: At each step of the algorithm there is a pair [U, W) of 
5-niodules such that V = U + W and U is known in terms of £ generators. At every 
repetition of the inner loop: W becomes a larger submodule of W, since at Step 
5 we know (from Step 3) that {U + W) n is strictly larger than W' . At every 
repetition of the outer loop: W becomes a smaller submodule of V , since at Step 5 
we know (again from Step 3) that W' is strictly smaller than W . Thus, the number 
of times the algorithm can loop is bounded by (dimT/)^, which makes the algorithm 
polynomial time. This gives a proof of Theorem 11.31 over large base fields. 

Over small base fields we use the algorithm of [FR85| or |CIW97j to compute the 
radical of A and the radical Vq of ^ therefrom and compute a minimal generating 
set Fq of the factor module V/Vq using Proposition 14.51 directly. For each uq G Fq 
we pick a representative u G uq + Vq and obtain a subset F C y such that |F| = |Fo| 
and F U Vb generates V . By a standard property of the radical, we show that F itself 
generates V . Indeed, let U be the submodule generated by F. li U ^ V then there 
is a maximal (proper) submodule [/' D J7 I) F. But U' >Vq hy the definition of Vb, 
therefore C/' ^ F U Vb, implying U' 3 V , which is a contradiction to U' being proper. 
This ends the proof of Theorem 11.31 

5. Concluding remarks. We have shown that the maximum rank matrix in a 
linear space generated by rank one matrices and a further matrix of arbitrary rank 
can be found in deterministic polynomial time if the rank one generators are given. It 
would be interesting to know if there is an efhcient deterministic method in the case 
where the rank one generators are not known. In this direction we have a deterministic 
polynomial time algorithm, which, given a matrix of maximum rank constructs a 
certificate that the rank is in fact maximal (see Theorem 12. 4p without knowing the 
rank one generators. This implies that over sufficiently large base fields, the maximum 
rank matrix can be constructed in Las Vegas polynomial time. The best result of 
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this flavor is the deterministic polynomial time algorithm of Gurvits [GurOSi IGur04] 
which decides whether there exists a nonsingular matrix in the space generated by 
rational matrices under the assumption that the span over the complex numbers can 
be generated by unknown rank one matrices (with not necessarily rational entries). 
Unfortunately, this algorithm decides the mere existence of a nonsingular matrix 
without explicitly constructing one. 

The space of the maps ■ A ^ V where y is a semisimple iS-module and A is the 
corresponding enveloping algebra has a curious property that if /iy is not of maximum 
rank there is a. v" & V such that Lemma 12.21 applies for h — fi^ and h" — fjLyu (see 
Lemma In particular, over a sufRciently large field F the rank of + afiyn will 
be higher for some v" chosen from an arbitrary basis of V and a "generic" a G F. 

It would be interesting to find more classes C of spaces of linear maps with such a 
"local rank incrementing" property: There is a constant c such that for every L G 
if h (z L is not of maximum rank then from an arbitrary basis hi, . . . ,hi of L one can 
choose maps /i^j , . . . , hi^ , such that h + aihi-^ + . . . + ctchi^ has higher rank for some 
ai, . . . , ttc G F (F is large enough.) 
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